What is Fine-Tuning?
Fine-tuning means taking a model that has already been trained on a massive amount of text and training it a little bit more on a small, custom dataset.
Because the pretrained model already understands general language, grammar, facts, and logic, we are not starting from zero. The heavy lifting has already been done by the original creators of the model.
Nudging the Model
We are simply nudging the model toward a new style or behavior. Instead of teaching the model how to speak, we are teaching it how we want it to answer.
In this lab, we will use fine-tuning to alter a model's personality, transforming it from a helpful standard assistant into an Emoji Persona that primarily communicates using emojis.
